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(57) ABSTRACT 

A file system has a hierarchical tree structure in which 
directories and files are placed under another directory. 
According to the hierarchical tree structure, the data of one 
image is assigned to one file and a group of image data is 
assigned a common directory name. A program for manag- 
ing the image data displays a thumbnail image based upon 
the image data of each file that belongs to a desired directory. 
With regard to another directory that belongs to the desired 
directory, a display is presented to clearly indicate that this 
is a directory and a thumbnail image based upon the image 
data of one file among the files belonging to this other 
directory is displayed as well. 
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FIG. 1 
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INFORMATION PROCESSING METHOD Further, the display 22 usually has a resolution which is 

AND APPARATUS FOR DISPLAYING A LIST low in comparison with that of the innage data that has been 

OF A PLURALITY OF IMAGE DATA FILES stored on the disk 30. When an image is displayed, therefore, 

AND A LIST OF SEARCH RESULTS processing such as subsampling is required. Accordingly, in 

5 a situation where a stored image is manually searched or 

BACKGROUND OF THE INVENTION verified, it is required that each image file be displayed one 

This invention relates to an information processing at a time. This is extremely inefiBcient. 

method and apparatus and, more particularly, to an infer- In order to improve upon these drawbacks, a filing system 

mation processing method and apparatus for displaying a list which performs a search using reduced images refened to as 
of a plurality of image data files as well as a list of search lo thumbnail images has been proposed. Such an example is 

results. illustrated in FIG. 2. 

The recent rapid increase in the power of computers and Numerals 20, 22 in FIG. 2 represent the personal com- 

in the storage capacity of magnetic disks and magneto- puter 20 and display 22 shown in FIG. 1. 

optical (MO) disks has led to the practical use of image filing A reduced image (thumbnail image) is produced fo r each 
systems and image databases for storing large quantities of is ii ^ggg"glgln advance and the thum bnail image is displayed 

image data. I tistead ot' the stored image havmg ihti Uligutal UiuitiislUiis . 

In these systems, images usually are stored on a computer Smce a thumbnail image has a smaller data size tnan tne 

disk in the manner exemplified by FIG. 1, which will now image of the original size, it is transmitted from the disk in 

be described. a shorter period of time. An additional advantage is that a 

Shown in FIG. 1 are an image scanner 10, a personal multiplicity of thumbnail images 23, 24, 25 can be displayed 

computer 20, a display 22 and a magnetic disk 30, which is on the display 22 at one time. 

built in the personal computer 20 or externally connected to Nevertheless, a system of this kind still has a number of 

the computer. disadvantages. 

The scanner 10 reads an image using an internal image Specifically, since a thumbnail image per se is merely for 

sensor (not shown), converts the image to a digital signal the purpose of displaying the general features of the full-size 

and then transmits the digital signal to the personal computer image, it is desired that the thumbnail image be in the same 

20 via e.g. an SCSI interface (not shown) and a cable 11. The file as that of the image of the full-size image. However, if 

image digitized by the scanner 10 is a monochrome bi-level a thumbnail image and the full-size image are included in 

image, an 8-bit grayscale image or a 24-bit full-color image, one file, the file must have a special format and it will not 

etc., and is capable of being selected in accordance with the be possible to read the file out of another application or from 

input image. a filing system. In addition, if the number of stored images 

The digital image read by the personal computer 20 is is large, problems arise in terms of the amount of data 

given a file name and then is stored on the magnetic disk 30. possessed by the thumbnail images. 

A plurality of items of image data that have been stored on On the other hand, if a thumbnail image and its full-size 

the magnetic disk 30 are read out and displayed on the image are placed in separate files, management becomes 

display 22 by having their file names designated by the more complicated. 

operator of the personal computer. in a case where a thumbnail image and its full-size image 

However, an image filing system of this kind has the are placed in separate files, an application which manages 
following problems: 40 filing must manage the correlation between the thumbnail 

First, since the quantity of image data is very large, image and full -size image. Consequently, when the user 

reading the designated image data out of the disk and executes processing such as movement, copying, renaming 

displaying the image data take time. For example, in case of or deletion of a file by the function of the operating system 

a 400-dpi monochrome bi-level image of size A4, the (OS) or by an application belonging to the OS, a contradic- 
amount of data is approximately two megabytes. If the 45 tion occurs with respect to correlation with the filing apph- 

image is a full-color image, the amount of data is about 48 cation. 

megabytes. As a consequence, a considerable period of time Another drawback is that a thumbnail image is produced 

is required even to transmit the monochrome image via the arbitrarily as a file irrespective of the volition of the user, 

interface (e.g. the SCSI and cable 21) between the personal Furthermore, if the number of stored images is large, prob- 
computer and the disk. In case of the full-color image, the 50 lems arise in terms of the amount of data possessed by the 

time required is much greater. thumbnail images. 

In general, image compression is carried out to solve this In order to prevent the occurrence of the above-mentioned 

problem. For example, the JPEG compression method is contradiction in terms of the correlation between a full-size 

used widely to compress full -color images. In accordance image file and its thumbnail image file, a filing system 
with the JPEG method, it is possible to compress image data 55 having a database structure has been proposed. wif[^ |hit^ 

to V20 to V30 of the original without much deterioration in database stnictiire. there are many cases where a pluralitv of 

image quality. However, even though the time for transmit- retr ieved files are displayed as thumbnail imae,es by per- 

ting data from the disk to the personal computer is shortened torming a search among a number of image files using a - 

when compression is carried out, processing for decoding keyword seared or ttie like, in a dat abase structure of this 
the compressed image data by the personal computer is 60 kmd, image files are managed within the database structure 

necessary. This means that considerable time is still and the file management structure is invisible to the user. For 

required. example, since the user cannot see the directory structure 

Second, in order to find a desired image among stored directly, a file which could not be retrieved as by a keyword 

images (this is referred to as a manual search) or to verify the search can only be retrieved by displaying files one after 
image, an enormous quantity of compressed image data 65 another. This is inconvenient. Further, even in a case where 

must be read out of the disk, decoded and then displayed files having a directory structure are provided on a separate 

each time. medium such as a CD-ROM, all images must be moved to 


10/16/2003, EAST Version: 1.04.0000 


us 6,335,746 Bl 

3 4 

a database area and a change must be made to a structure to image data file that belongs to a desired directory, first 

which the thumbnail images have been added. display means for displaying the thumbnail images gener- 

Thus, in the image filing system described above, the ated by the first generating means, second generating means 

foUowing drawbacks are encountered in a case where a generating a thumbnaU image on the basis of one unage 

manual search is performed to select a desired image from 5 data file among image data files that belong to another 

a luralit of ima es' directory belongmg to the desired du-ectory, and second 

^ ^ ^ ■ display means for displaying the thumbnail image generated 

1. A long period of time is required to display image for by the second generating means. 

the sake of verifying an image. ^ f^^ther object of the present invention is to decode, over 

2. With an image search using thumbnail images, a special a plurality of stages, coded image data capable of being 
type of management is needed to manage the thumbnail decoded at multiple levels, whereby it is possible to 
images and fuU-size images and diflBculties arise when discover, at a low-level decoding stage, whether an image is 
processing the images from the OS or another appli- a desired image, thereby raising the efficiency of image 
cation. retrieval. 

3. When there is a large number of filed images, problems 15 Other features and advantages of the present invention 
arise in terms of the volume of data of the thumbnail ^PP^^^^J following description taken in 
. conjunction with the accompanying drawings, in which like 

^ * reference characters designate the same or similar parts 

4. In an image filing system having a database structure, throughout the figures thereof, 
the structure cannot be seen by the user. As a result, 

inconveniences arise in a case where a desired image is 20 BRIEF DESCRIPTION OF THE DRAWINGS 

retrieved while displaying and verifying images. The accompanying drawings, which are incorporated in 

5. In an image filing system having a daubase sturcture, constitute a part of the specification, illustrate embodi- 
it is not possible for the user to manage image files '"'"'s °^ invention and together with the description, 
disposed under a desired directory. ^"^"^ '° principles of the invention. 

6. m order to perform an image search of another image ^ ' diagram showing the configuration of an 

u • J- * * . u .u ordinary apparatus which implements image data man age - 

file area having a directory structure, a change must be ment- 

made to a database structure. Operation is complicated ™^ -i j- i_- ifj i r 

,\. ^ FIG. 2 IS a diagram showing an example of a display of 

and processmg takes too mucd time. ^^^^^^ thumbnail images; 

SUMMARY OF THE INVENTION 30 FIG. 3 is a diagram showing the configuration of an 

information processing apparatus according to a first 

Accordingly, an object of the present invention is to embodiment of the present invention; 

provide an information processing method and apparatus in pj^ 4 ^ conceptual view showing a directory structure 

a file system having a hierarchical tree structure based upon according to the first embodiment; 

directories, wherein it is possible to disnlav thumbnail JFIG. 5 is a diagram showing an e.^^rr^^]^ , nf " ^■"^p'^y 

images of image data nles in accordance with the tree imaRe file retrieval processing: 

structure. ^— — ^— t pjQ g ^ ^ flowchart illustrating a file display procedure 

By making it possible to present such an image data file of one directory according to the first embodiment; 

display, the user can reu-ieve a desired image from a plurality FIG. 7 is a flowchart illustrating the procedure of image 

of images simply and at high speed. file display processing according to the first embodiment; 

Another object of the present invention is to indicate FIG. 8 is a diagram useful in describing processing for 

image data files present in one directory by thumbnail expanding JPEG-encoded data to a size which is of the 

images and, with regard to another directory which belongs original; 

to the first-mentioned directory, to indicate one image data FIG. 9 is a flowchart of directory display processing 

file present in this other directory by a thumbnail image, 45 according to the first embodiment; 

thereby making it possible to readily ascertain whether an FIG. 10 is a flowchart illustrating JBIG hierarchical code 

image data file is present in the other directory. display processing according to the first embodiment; 

In accordance with an embodiment of the present FIG. 11 is a flowchart illustrating JPEG display process- 
invention, there is provided an information processing ing according to the first embodiment; 
method for managing image data files by a file system 50 FIG. 12 is a flowchart illustrating directory display pro- 
having a hierarchical tree structure in which directories and cessing according to a third embodiment of the invention; 
files are placed under another directory, comprising a first FIG, 13 is a conceptual view showing an example of the 
generating step of generating a thumbnail image on the basis results of a search according to the third embodiment; 
of each image data file that belongs to a desired directory, a FIG. 14 is a flowchart showing an information processing 
first display step of displaying the thumbnail images gener- 55 procedure according to the third embodiment; 
ated at the first generating step, a second generating step of piG. 15 is a diagram showing the layout of program 
generating a thumbnail image on the basis of one image data modules stored on a prescribed recording medium capable 
file among image data files that belong to another directory being read by a computer; and 

belonging to the desired direaory, and a second display step pj^. 16 is a block diagram illustrating the construction of 

of displaymg the thumbnail image generated at the second 60 an information processing apparatus according to this 

generating step. embodiment. 

In accordance with another embodiment of the present 

invention, there is provided an information processing appa- DESCRIPTION OF THE PREFERRED 

ratus for managing image data files by a file system having EMBODIMENTS 

a hierarchical tree structure in which directories and files are 65 Preferred embodiments of the present invention will now 

placed under another directory, comprising first generating be described in detail in accordance with the accompanying 

means for generating a thumbnail image on the basis of each drawings. 
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According to the information processing method of this the magnetic disk 130, in the same manner as in the 

embodiment of the present invention, image data is managed arrangement of FIG. 1. However, images and files are in 

through a directory structure possessed by a file system, and one-to-one correspondence and the system is not provided 

one item of image data is managed by one file, whereby a with thumbnail images in advance, 

desired image is retrieved/displayed in accordance with a 5 Further, according to this embodiment, JPEG compres- 

directory structure. sion is used to compress color images and JBIG compres- 

In relation to display of directories and image files dis- sion is used to compress bi-levcl images. Here an extension 

posed under a single directory, one thumbnail image among jpg is attached to the file name of a color image compressed 

image files belonging to a directory is selected and dis- by JPEG compression to give 

played. With regard to image files, the thumbnail images file name .jpg 

thereof are generated and displayed. This makes it possible and an extension jbg is attached to the file name of a bi-level 

to realize a faster image search. image compressed by JBIG compression to give 

Further, processing is executed to obtain a detailed image file name jbg 

by displaying a list of image files disposed under a selected In this embodiment, a DOS/Windows system, for 

directory and selecting one file from the list of image files. example, is implemented as the operating system 1203a 

An information processing method and apparatus accord- (FIG. 16) and files are managed according to the names 

ing to embodiments of the invention will now be described "FILEl.jpg", "FILE2.jbg", . . . 

in detail. in one-image, one-file units under the ordinary DOS direc- 

[First Embodiment] 20 ^^^y s^^^cture. 

HG. 3 illustrates the configuration of an information An example of such file management is illustrated in FIG. 

processing apparatus according to a first embodiment of the ^ embodiment, by way of example, retrieval and 

present invention. The apparatus includes an image scanner ^"^V^^y of ^^^^ i°^ag^ managed in accordance with the file 

110, a personal computer 120, a display 122 and a magnetic directory structure of the kind shown in FIG. 4 is carried out. 

disk 130. T hj^^^P"^^^^ disk 130. which ma y be built in the 25 i^i^ncG, color images that have been read in by the 

ppr^nal rv^puter 120 or externally connected to the com - scanner 110 are named m the manner 

puter. FILEl.jpg, . . . , FILE6.jpg 

"TlcTe is a block diagram illustrating the constmction of ^^cse are subjected to JPEG compression and then the 

the information processing system according to this embodi- compressed images are stored accordmg to the directory 

ment. The personal computer 120 includes a CPU 1201 for 30 structure shown m FIG. 4. Bi-level images are named in the 

executing various control operations based upon control manner 

programs stored in a ROM 1202 or RAM 1203. The ROM FILET.jbg, . . . , FlLElO.jbg 

1202 stores programs such as a booting program and various these are subjected to JBIG compression and then the 

data. The RAM 1203 stores various control programs down- compressed images are stored on the magnetic disk 130. 

loaded from the magnetic disk 130. An operating system 35 In the directory structure of FIG. 4, image files from 

1203fl includes a file management system having a hierar- FILEl.jpg to FILE6.jpg and two directories "DIR-l*', "DIR- 

chical tree structure. An image data management program 2" exist under the directory name "DIR-A". 

1203b implements control indicated by various flowcharts Further, FILET.jbg, FILES .jbg belong to the directory 

described below "DIR-1", and two image files FlLE9.jbg, FlLElO.jbg 

n,e personal computer 120 fiirther includes an SCSI « present in the directory name "Dm-2" 

interface 1204 to which the scanner 110 is connected in this . The ullage data management propani 1203fr rf.tnfivp s 

embodiment, an IDE interface 1205 to which the magnetic J. A'^-^ '''"Pf^ m Ihfi mjipner des^bed above and 

disk 130 or CD-ROM 150 is connected, a parallel interface these imafie flies in the manq^f stiovffl >n FIG, 5. In 

nnr * u* u • * i An ' i A • ♦ TIG. 5, windows 1, 2, 3 display the retneved images. Each 

1206 to which a printer 140 IS connected, a display interface ^. ' , . ... t^tt^ a l 

. L - i_ *L J 1 m • . -J -J ♦ ™ 45 directory be loneine to the directory name DIR- A shown in 

1207 to which the display 122 IS connected, and a system a ^ -c i * *u • ci 

u nin uu * ™^ FIG. 4 and information relating to the image files are 

bus 1210 which interconnects the components mentioned , ._, ^^r^, ^ -ii.-^^ 

. displayed m the window 1. Windows from 2-1 to 2-6 

^ * . . J indicate image displays (referred to as "icon images*' below) 

The scanner 110 reads an miage, converts the image data correspond to the file namesof the file images belonging 

to a digital signd and then transmits tte digiUl signal to the ^ pj^.^ p^^^^^ ^.^^^^ ^-l and 3-2 

personal computer 120 by say, the SCSI interface 1204 via j^^j^^j^ .^^^ . ^^^^ directories that 

a cable 111. The miage digitized by the scanner 110 is a ^^^^ ^ ^^ p j^.^ Processing for displaying the 

?f'''f.^^.'"'^f ai^s under the directory name "DIR-A) of FIG. 4 

24.bit full<olor iniage, etc., and is capable of being selected (processing of the image data management program 12036) 

in accordance with the type of input image. ^, ^^^^^^^ ^^^^^^^^^ ^^ ^^^^ flowcharts of FIGS. 

The digital image read by the personal computer 120 is 6 and 7. 

given a file name and then is stored on the magnetic disk y^i^ regard to the relationship between the extension and 

130. A pluraUty of items of image data that have been stored coding method of image data handled, a case in which a 

on the magnetic disk 130 are read out and displayed on the monochrome bi-level image, namely the extension thereof, 

display 122 of the personal computer by having their file jg ".jbg", indicates that the data is coded data hierarchically 

names designated by the operator of the personal computer. ^oded by the JBIG method, and a case in which a color 

Tbesystemof FIG. 16 further includes a color printer 140, image or monochrome multiple-bit image, namely the 

a CD-ROM drive 150 and an input unit 160 including a extension thereof, is ".jpg", indicates that the data is coded 

keyboard and a pointing device. data coded by the JPEG method. 

According to this embodiment, an image is read and 65 The thumbnail images of FILEl.jpg through FILE6.jpg 

digitized by the scanner 110 and compressed by the personal are used as the displays for the icon images 2-1 through 2-6. 

computer 120, after which the compressed data is stored on Further, the icon images 3-1 and 3-2 indicate the directories 
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DIRl and DIR2, respectively. Borders 3-3, 3-4 are added to The detailed procedure of the image file display process- 

these icon images. It should be noted that the thumbnail ing executed at step S33 will now be described with refer- 

images of image files having the latest creation dates among ence to the flowchart of FIG. 7. 

the files FILE7.jbg, FILES.jbg, FILE9.jbg and FILElO.jbg According to the processing of FIG. 7, it is determined 

under rei^ective ones of the icon images 3-1, 3-2 are used 5 whether an image file is JBIG-coded data or JPEG-coded 

as these icon images. When DIRl is opened, a window is jata, the corresponding decoding processing is executed and 

displayed and the image files belonging to the directory jj^age data for display is created. 

"DIRl" are displayed in this window. Tlie thumbnail image ^ determined at steps S40 and S41 in FIG. 7 whether 

used for the icon image 3-1 is the thumbnail image of the ^ JBIG-coded data or JPEG-coded data. Since the 

unage file havmg the latest creation date among these maage « j - ^as been attached to an image file coded by 

files. In this example the icon image 3-3 is used. Further, he coding and ".jbg^' to an image file coded by JBIG 

Sdow r ' ^^^^g' ^^^P^ S^^' ^^"^^^^^ 

"^A processing procedure for presenting the display set f^?^^ f^^^^"' cL^^^^u"^"?"* ' "^^f 

forth above will now be described with reference to the ^^^ision is rendered at step S40 so that the program proceeds 

flowchart of FIG. 6. When the user enters a command (from 15 to step S42. Here JBIG-coded data having the lowest reso- 

the input unit 160) to display the files stored under the lotion is read out and decodmg processing is executed to 

directory DIR-A. the processing according to the flowchart obtain a thumbnail image. 

of FIG. 6 is executed. Id case of JPEG-coded data, a "YES*' decision is rendered 

Whether an image file or a directory is present in an at step S41 so that the program proceeds to step S43. Here 

entered directory name (e.g. "DlR-l") is determined at step 20 decoding processing of image data of Vs the size in the X and 

S30 by searching the file system having the data structure Y directions is executed using JPEG hierarchical decoding 

shown in FIG, 4. If an image file or directory is present, the processing, whereby a thumbnail image is obtained, 

program proceeds to step S31. If there is no file or directory, Decoding processing for Vs the size according to the JPEG 

processing is terminated. method will be described with reference to FIG. 8. Ordinary 

One file (or directory) not yet being displayed under the 25 JPEG-coded data is shown at 90 in FIG. 8. By subjecting this 

entered directory name is chosen and it is determined data to ordinary Hufi&nan decoding processing (91), a matrix 

whether this indicates an ordinary image file at step S31. If of 8x8 DCT coefficients 92 is obtained. By subjecting these 

the file is an ordinary image file, the program branches to DCT coefficients to 1x1 reverse DCT processing (93), an 

step S33. If the file is not an ordinary image file, then the image having Vs the size in both the X and Y directions is 

program proceeds to step S32. A thumbnail image of the 30 restored. In other words, only the DC (direct current) 

corresponding image file is generated and displayed on the components among the DCT coefficients are decoded to 

display 122 at step S33. The program then returns to step obtain a thumbnail image reduced to Va the size. 

S30, at which the processing described above is repeated. Next, at step S44 in FIG. 7, processing is executed to 

The details of file display processing executed at step S33 adjust the image size in such a manner that the image data 

will be described later with reference to the flowchart of 35 decoded at step S42 or S43 will take on a size suitable for 

FIG. 7. the search image display (e.g. the size of the icon images 

It is determined at step S32 whether the chosen file (or 2-1-2-6). This processing is such that if the size of image 

directory) indicates a directory. In case of a directory, the data obtained by decoding is larger than the icon image size 

program branches to step S34; otherwise, the program shown in FIG. 5, reduction processing is applied to the 

returns to step S30 and processing the same as that described 40 image data in such a manner that the latter size will be 

is executed. Directory display processing is executed at step obtained. On the other hand, if the size of image data 

S34, the program returns to step S30 and the same process- obtained by decoding is smaller than the icon image size, 

ing is executed. The delafled procedure of directory display enlargement processing is applied to the image data. As a 

processing executed at step S34 will be described later with result, even if the sizes of the original images are diflferent, 

reference to FIG. 9. 45 the icon images displayed as shown in FIG, 5 can be 

Thus, the same processing is executed until the display of displayed so as to have the same size, 

all files (or directories) under the designated directory name It should be noted that one having ordinary skill in the art 

(e.g. "DlR-A") is completed. can select well-known subsampling processing or interpo- 

The processing of FIG. 6 set forth above will now be lation processing as the above-mentioned reduction process- 
described with reference to a specific example. The decision 50 ing and enlargement processing. 

processing of steps S30~S32 is merely for determining After a search display image has been displayed in the 

whether an entered data string is indicative of an ordinary window, the file name of this image file is displayed at step 

file or directory. Accordingly, this decision processing can S45, 

be carried out merely by examining the file attributes The details of file display processing according to step 

indicated by the data string. 55 S33 have been described. Next, the details of the procedure 

In the example of the directory structure shown in FIG. 4, for directory display processing executed at step 834 in FIG. 

first FlLEl.jpg is displayed. Since FILEl.jpg is an ordinary 6 wiU be described with reference to the flowchart of FIG. 

file, the "FILE" decision is rendered at step S31 in FIG. 6, 9. 

the program proceeds to step S33 and FILEl.jpg is 6is- A directory icon is displayed at step S50. According to 

played. The same operation is performed with regard to the 60 this embodiment, an icon having a border of the kind 

succeeding files FILE2.jpg, FILE3.jpg. indicated at icon images 3-1 and 3-2 in FIG. 5 is displayed. 

Next, in a case where "DIR-l" is displayed, the program This is followed by step S51, at which it is determined 

proceeds from step S31 to step S32, the "DIRECTORY" whether image files exist under this displayed directory. If it 

decision is rendered and the program branches to step 834. is found that there are no image files, then the program 

Processing for displaying this directory is then executed. 65 proceeds to step 854, where the name of the directory is 

Similar processing is executed also with regard to the final displayed. In this case a display of a thumbnail image is not 

"DIR-2". presented. Conversely, if image files do exist under the 
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displayed directory, the program proceeds to step S52. Here 
one thumbnail image of an image file under the directory is 
displayed. According to this embodiment, the latest image 
file is selected and the thumbnail image of this file is 
displayed, as mentioned earlier. This is followed by step 
S53, at which the first file of the adjusted size in the directory 
is displayed in the directory icon, and then by step S54, at 
which the directory name (e.g. DIRl, etc.) is displayed. 

In this embodiment, it is possible to assign image files that 
continuously enter from a scanner or the like to a directory 
having a "book" attribute. As a result, continuously entered 
image files can be stored in one directory, thereby fadhtat- 
ing management of the image files. A directory of this kind 
is indicated by icons 3-3, 3-4 having borders in the manner 
of the directories DIRl, DIR2 in FIG. 5. 

Further, in the case where the directory having the 
attribute "book" is displayed, an arrangement may be 
adopted in which the image of the first page is displayed in 
the directory icon. 

The directory icon DIRl (3-1) in FIG. 5 displays a list of 20 
image files that are under the directory in a case where the 
user has designated the display of the files that are under this 
directory. In other words, the file d isplay prnrpssing 
described in FIG. 7 is executed and the size-adjusted thumb- 
nail images are disp layRH in the manner shown in window 2 
in FIG. ^. H ere 3-3represents the image of the first page 
indicated in the icon of directory 3-1, and 3-4 represents the 
image of the second page. 

The path name DIR-A/DIRl is displayed in the title of the 
window 2. Furthermore, it is possible to display the details 30 
of the image files as well. 

The detailed image of FILE7.jbg of window 2 in FIG. 5 
or the full-size image can be displayed in the following 
manner: Specifically, in a case where the user has designated 
display of FILE7.jbg of window 2, the window 3 is opened, 35 
the corresponding detailed image is displayed, as shown in 
FIG. 5, and the path name+file name 

"DIR-A/DIRl/FILE7.jbg 
is displayed as the title. 

The procedure through which a designated image file is 40 ture stored in the magnetic disk 130 has been described in 
displayed in full size will now be described. 
<Processing for displaying JBIG-coded image> 
In the case where JBIG coding is used to code an image, 
the coded image is constituted by a hierarchical code and is 
decoded/displayed through the processing procedure shown 45 
in FIG. 10. For a desired image file, a command requesting 


level of the thumbnail image rises and gradually approa ches 
The original image. For instance^ in ttic example or MU. j: 
the decoding level of the ima^e displayed in window 3 rises 
whenever the icon image 3-3 is designated and the complete 
decoded image is finally displayed after designating the icon 

image a certain niimhe r of tocs. 

<Processing for displaying JPEG-coded imago 
On the other hand, in a case where an image file desig- 
nated for full-size display of the image has been coded by 
the JPEG method, display processing indicated by the flow- 
chart of FIG. 11 is executed whenever the icon image is 
designated. 

The JPEG code is subjected to reverse DCT (RDCT) 
Hufltman decoding at steps S70, S71 to obtain DCT coeffi- 
cients. This is followed by steps S72, S73 and S74 at which 
the size of the image currently being displayed is designated 
and RDCT of a size greater than the current size is executed 
to obtain a detailed image. 

For example, in a case where the currently displayed 
image is an icon image, i.e., an image of size VsxVs, the 
thumbnail image has been decoded by 1x1 RDCT process- 
ing. As a result, 2x2 RDCT processing (step S75) is 
executed and an image of size VaxVi is obtained. The image 
obtained is then displayed in the image display window at 
step S78. 

If an image is already being displayed in the image 
display window, it is determined whether the displayed 
image is of size VaxVa or If the displayed image is of 
size V4XV4, the program proceeds to step S76, 4x4 RDCT 
processing is executed and an image of size V^xVi is 
obtained. The image obtained is then displayed in the image 
display window at step S78. If image currently being dis- 
played in the image display window is of size VixVi, the 
program proceeds to step S77, an image of size 1x1 is 
generated and the image is displayed in the image display 
window. It should be noted that this image display window 
is displayed in the manner of window 3 in FIG. 5. 

[Second Embodiment] 

Retrieval and display of image files of a directory struc 



display of a high-resolution image of the directory is entered 
from the input unit 160. If the designated image file has been 
coded by JBIG coding, processing shifts to step S60 in FIG. 
10. According to this embodiment, designating an icon 50 
image issues the command requesting the highresolution 
image display of the coded image data corresponding to this 
icon image and causes execution of the processing of FIG. 
10. 

It is determined at step S60 whether a desired image file 55 
has a hierarchical image of a higher resolution. If the answer 
is "YES", the program proceeds to step S61. If the answer 
is "NO", then processing is terminated. This is followed by 
step S61, at which the image one hierarchical level higher 
than the resolution of the image currently being displayed is 60 
decoded. 

Next, at step S62, the decoded image is displayed in the 
window. An example of this display is indicated in window 
3 of FIG. 5. 

The foregoing processing is execut ed whenever a corre- 65 
spending thumbnail image is oesi^natea. Accordingly, Fy 
repeatedly designating a thumbnail image, the decoding 


the first embodiment. Since absolutely no additional data 
other than the data of the ordinary directory structure is 
generated, the present invention can be implemented in 
similar fashion also with regard to a storage device that 
cannot be written, such as the CD-ROM drive 150. In other 
words, if an image file having a directory structure stored on 
a CD-ROM possesses a file structure of the kind shown in 
FIG. 4, the content of the CD-ROM can be searched/ 
displayed in the same maimer as set forth in the first 
embodiment. 
[Third Embodiment] 

It is described in the first embodiment that an icon and 
directory name are displayed in a case where a directory is 
displayed. In the third embodiment, a case is described in 
which, when a directory is displayed, an icon, the directory 
name and the number of files arrayed under the directory are 
displayed. 

The operation of the third embodiment will be described 
with reference to the flowchart of FIG. 12. Steps S50 and 
S54 in FIG. 12 represent processing identical with that of 
steps S50 and S54 of the first embodiment (FIG. 9). That is, 
if a directory is displayed, the processing for displaying a 
directory icon and the directory name is the same as that 
described in the first embodiment. According to the third 
embodiment, these steps are preceded by an additional step 
S90, which is processing for counting the number of files 
disposed under the directory and displaying the number. 
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More specifically, at step S90, a file (not shown) which 
manages the directory is opened, the content of the directory 
is read out in accordance with the formal of directory 
management and the number of JPEG-coded files and JBIG- 
coded files being managed by this directory are counted, The 5 
number of these files is displayed at the same time as the 
directory icon. 

A cn^e. in whirh ihe. rp.siiUf^ pf S'^ar^h pr^^**''''i"f; "^^ ti 

keyword search, for exa mple, will be considered as a 
moaincation ot tnis emboaimenL ^ere a case will be lo 
described in which the items of information obtained as the 
results of a keyword search are thff filf' r.>>fv>^c- th^ f..ii p^j^j^ 
with the directory names attached, as shown in FIG. 13. To 
tacUitate an understanding of this embodiment, it will be 
assumed that six image files have beea_cetde_ved from the. 15 
tiles ot' the directory structure_shownJn FIG. 4 . 

The procedure for displaying the retrieved images will be 
described with reference to FIG. 14. 

Initialization processing is executed al step S80 in FIG. 
14. For example, the area which stores the immediately 20 
preceding directory name is cleared for the purpose of 
comparing directory names. Further, it may be arranged to 
execute processing for extracting the directory name from 
the file name of the full path stored at the beginning of the 
search results and opening the window of this directory. 25 
Next, at step S81, it is determined whether all processing 
relating to the search results has been completed. Processing 
is terminated if the answer is "YES". If processing is still in 
progress, then the program proceeds to step S82. 

At step S82 the directory name is extracted from the file 30 
name stored in the full path of the search results. It is 
determined at step S83 whether the directory name that has 
been extracted is the same as the directory name currently 
being displayed. If they are the same, the program proceeds 
to step S33 so that a transition is made to processing for 35 
displaying the retrieved image data. If the directory names 
are found not to be the same at step S83, then the program 
proceeds to step S84. Here it is determined whether another 
directory name is already being displayed. If another direc- 
tory name is not being displayed, the program proceeds to 40 
step S34, where processing for displaying the directory is 
executed. 

An instance in which the foregoing processing is executed 
with regard to the data shown in FIG. 13 will be described. 
It will be assumed that the window for DIR-A is currently 
being displayed. Alternatively, it will be assumed that the 
window "DIR-A'* has been opened from the starling file 
name "DIR- A/FILE l.jpg" by the processing of step S80. 
First, with regard to the initial "DIR-A/FILEl.jpg", this 
directory name becomes "DIR-A" at step S82 so that 
directory now displayed becomes "DIR-A". 

Since DIR-A is the window currently being displayed, the 
program branches al step S83 and processing proceeds to 
step S33, where processing for displaying FILEl.jpg is 
executed. Since the directory is DIR-A also for the succeed- 
ing "DIR-A/FILE2.jpg" and "DIR-A/FILE4.jpg", process- 
ing for displaying the retrieved images is executed in the 
same manner as set forth above. 

In the case of "DIR-A/DIRl/FILE7.jbg", the directory 
name becomes "DIR-A/DIRl" at step S82. Since this is 
different from the directory name (DIR-A) now being 
displayed, processing proceeds to step S34 via step S84 so 
that the directory is displayed. 

Directory display processing is executed in similar fash- 
ion with regard lo "DIR-A/DIR2.nLE9.jbg*'. Further, direc- 
tory display processing is executed in similar fashion with 
regard to "DIR-A/DIR2/FILE9.jbg. In case of "DIR-A/ 
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DIR2/FILE.10jbg**, processing proceeds lo step S84. 
However, since "DIR2" is being displayed, processing 
returns to step S81 without a new display being presented. 

Thus, in accordance with the third embodiment, the 
number of files being managed by a directory can be 
ascertained and file retrieval efiBciency can be improved. 

In each embodiment illustrated above, it is described that 
JBIG coding is used for monochrome bi -level images and 
JPEG coding for color images. However, it goes without 
saying that the present invention is not limited to these 
coding methods and may be implemented with other coding 
methods as well. 

Further, with regard to JPEG coding, it is described that 
a retrieved display image is reproduced by JPEG hierarchi- 
cal decoding. However, ordinary JPEG decoding may be 
employed as well. In such case it goes without saying that 
reduction processing for displaying results of retrieval 
would be executed after the original image has been repro- 
duced. 

Further, it has been described that a directory icon is 
displayed in case of a directory. However, the present 
invention is not limited to such an arrangement. 

The present invention is not limited lo the illustrated 
screen layout for displaying results of retrieval. 

The present invention can be applied to a system consti- 
tuted by a plurality of devices (e.g., a host computer, 
interface, reader, printer, etc.) or to an apparatus comprising 
a single device (e.g., a copier or facsimile machine, etc.). 

Further, it goes without saying that the object of the 
present invention can also be achieved by providing a 
storage medium storing program codes for performing the 
aforesaid functions of the foregoing embodiments to a 
system or an apparatus, reading the program codes with a 
computer (e,g., a CPU or MPU) of the system or apparatus 
from the storage medium, and then executing the program. 

In this case, the program codes read from the storage 
medium implement the functions according to the 
embodiments, and the storage medium storing the program 
codes constitutes the invention. 

Further, the storage meditun, such as a floppy disk, hard 
disk, optical disk, magneto-optical disk, CD-ROM, CD-R, 
magnetic tape, non-volatile type memory card or ROM can 
be used to provide the program codes. 

Furthermore, besides the case where the aforesaid func- 
tions according to the embodiment are implemented by 
executing the program codes read by a computer, it goes 
without saying that the present invention covers a case 
where an operating system (OS) or the like working on the 
computer performs a part of or the entire process in accor- 
dance with the designation of program codes and imple- 
ments the functions according to the embodiments. 

Furthermore, it goes without saying that the present 
invention further covers a case where, after the program 
codes read from the storage medium are written to a function 
extension board inserted into the computer or to a memory 
provided in a function extension unit connected to the 
computer, a CPU or the like contained in the function 
extension board or function extension unit performs a part of 
or the entire process in accordance with the designation of 
program codes and implements the function of the above 
embodiments. 

In a case where the present invention is applied to the 
above-mentioned storage medium, program codes corre- 
sponding to the flowcharts described earlier are stored on the 
storage medium. More specifically, the modules shown in 
the example of the memory map of FIG, 15 are stored on the 
storage medium. 
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That it is, it will suflBce to store the program codes of at 
least the following modules on the storage medium: a "file 
display module" for displaying thumbnail images of files 
(image data) that belong to a prescribed directory, and a 
"directory display module" for displaying a thumbnail 
image of one file (one item of image data) belonging to 
another directory that belongs to the prescribed directory. 

In accordance with each of the embodiments as described 
above, displaying image files having a directory structure 
makes it possible to retrieve the images in accordance with 
the directory structure so that the efiSciency of image 
retrieval can be improved. 

Further, by displaying retrieved images as thumbnail 
images per each directory, image decoding time is short- 
ened. 

Furthermore, by decoding and displaying only a desired 
image as a detailed image or original image, a further 
improvement in image retrieval efficiency can be achieved. 

Thus, in accordance with the present invention as 
described above, retrieval of prescribed images from among 
a plurality of images can be performed simply and at high 
speed. 

As many apparently widely different embodiments of the 
present invention can be made without departing from the 
spirit and scope thereof, it is to be understood that the 
invention is not limited to the specific embodiments thereof 
except as defined in the appended claims. 

What is claimed is: 

1. An infonnation processing method for managing image 
data files by a file system having a hierarchical tree structure 
in which directories and files are placed under another 
directory, comprising: 

a first generating step of, generating a thumbnail image on 
a basis of each image data file that is placed under a 
desired directory; 

a first display step of, displaying the thumbnail image 
generated in said first generating step as an icon for an 
image data file; 

a second generating step of, when a second directory is 
placed under the desired directory, selecting one image 
data file from one or more image data files placed under 
the second directory and generating a thumbnail image 
on a basis of the selected image data file; and 

a second display step, of displaying the thumbnail image 
generated in said second generating step as an icon for 
the second directory together with the thumbnail image 
displayed in the first display step, the icon for the 
second directory being distinguishable from the icon 
for an image data file displayed in the first display step. 

2. The method according to claim 1, wherein said first and 
second display steps display the thumbnail images in a first 
window. 

3. The method according to claim 1, further comprising a 
third display step which, in a case where a thumbnail image 
displayed at said first display step has been designated, is a 
step of displaying, in a second window, a full-size image of 
the image data file that is the source of the thumbnail image 
that has been designated. 

4. The method according to claim 1, further comprising an 
execution step which, in a case where the thumbnail image 
displayed at said second display step has been designated, is 
a step of executing said first generating step, said first 
display step, said second generating step and said second 
display step with regard to a directory that corresponds to the 
thumbnail image that has been designated. 

5. The method according to claim 4, wherein said execu- 
tion step causes display of the thumbnail images in said first 
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and second display steps to be performed in a different 
window for every directory of interest. 

6. The method according to claim 1, wherein the image 
data is JPEG-codcd image data. 
5 7. The method according to claim 1, wherein the image 
data is JBIG-coded image data. 

8. The method according to claim 1, wherein the image 
data files are coded image data capable of being decoded in 
multiple stages, and said first generating step adopts an 
image, which is obtained by decoding the coded image data 
at a lower level, as a thumbnail image. 

9. The method according to claim 8, fiirther comprising a 
size correcting step of enlarging and reducing size of a 
thumbnail image obtained in said first generating step to a 

J J size suitable for display in said first display step. 

10. The method according to claim 8, further comprising 
a third display step which, in a case where a thumbnail 
image displayed in the first display step has been designated, 
is a step of decoding, at a decoding level higher than the 
decoding level of said thumbnail image, coded image data 
that is the source of thumbnail image that has been 
designated, and displaying, in a second window, the image 
that has been obtained. 

11. The method according to claim 10, further comprising 
2j an updating step which, in a case where a thumbnail image 

for which the image is already being displayed in the second 
window in said third display step has been further 
designated, is a step of decoding the coded data of said 
thumbnail image at a decoding level still higher than the 
decoding level of the image being displayed in the second 
window, and updating display of the second window using 
the image that has been obtained. 

12. An information processing apparatus for managing 
image data files by a file system having a hierarchical tree 
structure in which directories and files are placed under 
another directory, comprising: 

first generating means for generating a thumbnail image 

on a basis of each image data file that is placed under 

a desired directory; 
40 first display means for displaying the thumbnail image 

generated by said first generating means as an icon for 

an image data file; 
a second generating means for, when a second directory 

is placed under said desired directory, selecting one 
45 image data file from one or more image data files 

placed under the second directory and generating a 

thumbnail image on a basis of the selected image data 

file; and 

a second display means for displaying the thumbnail 
50 image generated by said second generating means as an 
icon for another directory together with the thumbnail 
image displayed by said first display means, the icon 
for the second directory being distinguishable from the 
icon for an image data file displayed by said first 
55 display means. 

13. The apparatus according to claim 12, wherein said first 
and second display means display the thumbnail images in 
a first window. 

14. The apparatus according to claim 12, further com- 
60 prising third display means which, in a case where a 

thumbnail image displayed by said first display means has 
been designated, is for displaying, in a second window, a 
full-size image of the image data file that is the source of the 
thumbnail image that has been designated. 
65 15. The apparatus according to claim 12, further com- 
prising execution means which, in a case where the thumb- 
nail image displayed by said second display means has been 
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designated, is for executing said first generating means, said 
first display means, said second generating means and said 
second display means with regard to a directory that corre- 
sponds to the thumbnail image that has been designated. 

16. The apparatus according to claim 15, wherein said 5 
execution means causes display of the thumbnail images by 
said first and second display means to be performed in a 
different window for every directory of interest. 

17. The apparatus according to claim 12, wherein the 
image data is JPEG-coded image data. lO 

18. The apparatus according to claim 12, wherein the 
image data is JBIG-coded image data. 

19. The apparatus according to claim 12, wherein the 
image data files are coded image data capable of being 
decoded in multiple stages, and said first generating means 15 
adopts an image, which is obtained by decoding the coded 
image data at a lower level, as a thumbnail image. 

20. The apparatus according to claim 19, further com- 
prising size correcting means for enlarging and reducing size 

of a thumbnail image obtained by said first generating means 20 
to a size suitable for display by said first display means. 

21. The apparatus according to claim 19, further com- 
prising third display means which, in a case where a 
thumbnail image displayed by the first display means has 
been designated, is for decoding, at a decoding level higher 25 
than the decoding level of said thumbnail image, coded 
image data that is the source of thumbnail image that has 
been designated, and displaying, in a second window, the 
image that has been obtained. 

22. The apparatus according to claim 21, further com- 30 
prising updating means which, in a case where a thumbnail 
image for which the image is already being displayed in the 
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second window by said third display means has been further 
designated, is for decoding the coded data of said thumbnail 
image at a decoding level still higher than the decoding level 
of the image being displayed in the second window, and for 
updating display of the second window using the image that 
has been obtained. 

23. A computer readable memory storing a control pro- 
gram for managing image data files by a file system having 
a hierarchical tree structure in which directories and files are 
placed under another directory, comprising: 
code for a first generating step, of generating a thumbnail 
image on a basis of each image data file that is placed 
under a desired directory; 
code for a first display step, of displaying the thumbnail 
image generated in said first generating step as an icon 
for an image data file; 
code for a second generating step, of, when a second 
directory is placed under the desired directory, select- 
ing one image data file from one or more image data 
files placed under the second directory and generating 
a thumbnail image on a basis of the selected image data 
file; and 

code for a second display step, of displaying the thumb- 
nail image generated in said second generating step as 
an icon for the second directory together with the 
thumbnail image displayed in the first display step, the 
icon for the second directory being distinguishable 
from the icon for an image data file displayed in the first 
display step. 

* * * * * 
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